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ABSTRACT 

The plans and procedures used by four teachers in 
making good tests are presented, and examples are given to serve as 
guides. The four tests are: An Objective Achievement Test on 
Fifth-Grade Arithmetic; An Essay Test to Measure a Special Ability in 
Eighth-Grade American History; A Tenth-Grade Biology Test Especially 
Designed to Hank Students in Order of Ability; and A Twelfth-Grade 
English Test for Diagnosing Common Errors in Usage and Spelling. 
Following descriptions of the tests, basic rules of test-making 
illustrated by the four tests are given; these are: (1) have the 
purpose of the test clearly in mind„ (2) make a careful plan for the 
test questions; (3) if test is mainly diagnostic in a basic skill 
area, prepare at least 10 questions (preferably more) for each 
subtest used; (4) to find out how well the class has mastered a 
particular unit of study, make a test which parallels the work in 
class, and (5) to rank a selected group of students in order of their 
achievement, the questions hould be on "critical" points of learning^ 
Special problems in writing and scoring tests are determining when 
essay questions and when objective questions should be used, writing 
questions that are understandable, stating questions so that there 
can be only one interpretation, improving reliability in scoring 
essay questions, the kind of sta'ristical analysis the teacher should 
make of test questions, and when to use a published test and when the 
teacher should make his own. (DB) 
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All toadiors liavf> lf> nialu^ Icsts. F^iit nijikini; .ix- r.' ^.\sis: is 
not c'iisy. Tlio purpose of this paniphlt=( is to ofTrr j^rju iiial 
sii«:^;i(\stions which may Ix'lp yon lo mnkr hclKT U'sis 

To mnk(» a gmn] t.o.sl. yon should jjnvo rl(\irly in mind 
what you aro i(\^tinj: Tor and liow yoii i)Jan to nso Mic 
r(" uUs. A rar<>fnily i)hni{HM] unit of sindy r;(«s( r\ a cure- 
i'liUy i)!ariiu'fl ii^M covf^rin^^ the uni(. As you know, «,a)Of? 
(osls art* not ,iiad(* hy Tn('r('ly "lin'owini: tn^idhor'" ciuo^lions 
moro or less rolaicd to iho work you have \)ovn toactiin*; 
until you have writlcMi cnoii^jli to keof) the puj)ils iMisy for 
a Hass period. A tf.sl pr(^par(^cJ in a liaplia/arrl mannt^r wiil 
not roally tell you how nuuli your j>U])ils hav(* h»arnofl, 
FurtFicriiioro, it may veil loavc* your pupils ( (infusi d ahout 
what f.h(\v ar(* supj)us(Ml f(> havo hvinu'ri. 

T.oi u.s cons(di»r tin- plans and [Trofc-chiros used hy fotir 
toa('li<n\s in mrdunji jiood t(^st^ Their efforts ilhisf rate liasie 
j^t'noral principles for eonsirut^tinf^ ((sts to meet si)(H^ine 
(•la.ssroorii needs. First, the forethouulils and proecnlurc^s of 
( aeh fciiehr-r will lie (lc\s(Tihed. Then fhe ^^(Mieral rules will 
he stat(Ml. 



An ()hjo(ti\-c A( hicvcrncnt Test on 
riftli-Gi adc Ai iihniet ic 

It was near the end o{ tlie selmoi year and Mrs. Jackson, 
fifth-t;rado teachf^r, decided to f;ive her pujMls an arithmetic 
t-est coverint; the year's v.ork. Hit first sto)) was to Ii?>t Mie 
kiiKls of information sfie fioped lo [;el from the test, ^'dl(^ 
decided that, most n{ all. she wanted to f,'et a general pic- 
ture of clayis a<'I]ievement with som(? indication of over-aJJ 
areas of ,strenfith and weakness. Secorulary ])urposes sJie 
li,sted were fl) to identify thost^ pui)ils who iraf^'d h^ esp >- 
cially weak in a i-)articular arithmetic skill anri (2) to 
measure the relative nhilities of her sturlent.^ for ])urposc-s 
of report-card gradin^^, 

Fn tryinp; to f(ot an atx^ural(^ picture of over-all class 
achievement, she d(^cided that there W(^re two way.s in 
wliieh ,she cou]r] classify the years work: one wa.s aecord- 
int^ t(t the hind of coinputaiwu required, anfl the other was 
accordin^^ to the way the problem ivas jjresented. 

The kinds of computation requireci were 

1. Multiplication 

2. Division 

3. Addition and Suhtraction of Fractions 

4. Measurinj^ (distance, time, weight. lemi)era<ure, etc.) 

5. Decin\al.^ 

The ways the problems were j) resented wore 

1. Simple compulation, such as 21/$ 1.05 
or 1/2+1/3 

2. Problems requiring use of procedures learned previously, 
.such a.s 



■Joliri missed 1 /fi of Iwcniy words (^n a spel!in.<| test, 
many vM^rrls did he niiss'.^ 

(tr 

.A i^roup k4 (went \'-ntne chihlrcn were making proLirams 
lor a sclit)ol assembly. Thry rn-edc-d -i;].~> pr(i;;rams. 1 lov,- 
many rlid each chWd have to make? 

3. Frolileius rccpiirinj:; orif'iiinal thiriking by jnipils and use 
of ''number sens(>." fii these f)rohlems (he jaipils ('(aild nr)l 
i\v\K»i\i\ c/fi pr(>\'iou.s-|y h^arnofl f)roe('(iur<^s hfr a fue{h<j<l of 
solution hut must devehip their own procetlu res {or solu- 
tion. Tw() probliMus »>f this tyj)e follow: 

Proldeni oni^ Kxplain how you. as a til t h -gr;ul«' pupil, using 
ten hlock.s, t tjold pr{)Vt> to a fourHi -gjiule pupil thai 1/2 is 
bigg(M- than 2/5. 

!'robleiii two, You iuv. standing diroetly in tVont ot* HiiilfUng 
'V and looking oil' at liuilding I?, in \ \m- distanre. Here is <.he 
way thti two builciings look {o you: 




TIk^ rooms in hotli hnildings an; thci s::m(; lioigtit, Hy looking 
at i\m\ windows, (iecidti which of the foH«)wing i,s true: 

(A) Hoth huiUiings ar(» the same height., 

(B) Building A i.s two-thirds as high a.s IJiiiJdiiig 

{C) Bui I ding A Ls one and one- third times as high as Build- 
ing B, 

(D) Building A i.s twice n,s high as Huilding B. 

(K) You can't tell from looking al in<'. buildings wliich one 

is higher, 

(Answer: B) 

Using thes(^ two ways for classifying the questions (accord- 
ing to the kind of con\putation requirefl and according to 
the way tlie firoblem was i)resentod). Mrs. Jackson was 
now ready to nuike a ivrittcn plan for the test. She intended 
(hat this [)lan wduki! ()rovide for a tost parallelinff the em- 
phasis given to various poinLs in class. 

Mrs. dack.son wrote out her test plan in the form of a 
"two-way grid." In a two-way grid each cpiestion is elassi- 
fted in two din\ensions. 

The twx)-\vay grid that Mrs, Jackson made for the arith- 
metic test is on page 2. Since she planned to allow an hour 
for the test, she thought 40 questions woidd be about the 
right numbor. The number.? in the boxes represent ques- 
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diin«-iision.s itl \ hf ^^rifl. 

H'jy rri<hl<:ni Pr''\:nh\i 

[ ■[■huLiL;htriohl».-;n> Tf:L'ui:iiU iYobk:n-i.-» j 

Kiiuhil : rt-'[!(.''.vjn^: Ti'.'jc- ; Kct, iiiring Stu- j 
i 'tfmpur-Jiioi ; l(.LiLi[[iv. i durcs TiKii;[r. i'lc- : >.k"nis m Devckip i 

R':(iuir\\l ■ C.onipul;ilii'n l\i'.u)^!\ t Nc-v (*{-iK'0(Ji,rc.s j 

Tii^Liions ' 7 ' ■ ] i 

• ■■- • : • • ! 

Miilliplij.itio;) , 2 \ y \ \ I 

;- ■ : i ! 

Mcasnrii!^: I ; 5 j I ] 

^JL'l.•l!^;!i^ } }■. . \ ! 



AHt-r Mrs. -}:icks<.j, (.-urnpli-li-^l Hie {^^(> w;iy jrrid, sfu' 
i'(.'Ur)(i it r-'l.'it iw'l \- t itsv in \vrit(' \uk\>\ Ihc (]if<'sJ ions [\ir 
l]»r' test. Sin- wns aliic (o write man}' ions by ]iiU'aI- 

N'iin.L,' (jvicsl ifins \'v<\vi\ (fic /iri f luiH't ic icNlIuM)!-: ils(']r. I Iow- 

prohlt-nis ^vlli('^] wCiuUi ircjuirt- sfiidtMifs in djAflop hcnn' 

! (Tf H'l'dlU'f S. 

Mrs. 'JacksjJii Ix'tii^s-twl {\va\ flic !<\st (■o\'or('d iiriclfTst.'ituI 
i!i^;s and skills in wliic]^. her- pupils find hciMi Wf^ll pip|>;ii('d. 
"] {if'fcrdri*. shi' ('\p<'i'tt'd flu' N'cry Ih's< slufJrnls in ;d! nr 
. ncai'iy :dl ol" ilu' qifcsl ii>iis i if;hl, and slic cxpi-iicd I'vcn lix' 
iK'h>\\'-av<:'ra.;;(' sdulcnis to a t^iajoiitv cil' the cincstintis 
ri^li(. Slu' (lid nnl. !u}wr\('}-. rnako Uic niislakc' oi' clcciflirti; 
in a(h-an(;(* ihal sr-nir rnininiiEtn s^t'ir — sa\' 2.S rjiu-stions 
rii^jjl (7f^ '/,)- -\^■()uld rcpir'sc^n [ a passin.u mark. Slu» knrw 
iidni prcK'iniis rxpcricncr ih;il sonu'iirnrs Imm' <pl^^sti()^s 
turrird nuf fo Ik^ niorr dilficuh iJiarr (lirv (iisl sccMiicd io 
luM*. Slio d<H:idtHl lr> wad unfil siif CMnld look ;d ihc scori^s 
actually mad(^ on ilie wholo {(-si and nuild scnil ini/i^ rare- 
("uMy any riut'slions \vhi(.:h prf>\fd pail icnlarly in)id>loi^oinf\ 

As il hap[)CMi(HL inosl of ihv .^^fudcnts did wf^M o\\ Uio ^osf. 
aHhnuj;li no on(^ \y<.u\ a pfM'lVt't pai)('r. On the !>asis uf thr 
t<-s(, Mrs. Jackson fell that \\ov cla.ss luui achiovocl tlu^ 
ohjct.M ivps o\ ilic work in arillnn(^tic. She did notice. 1u)\n'- 
{'vrr. ilial a nnrnlKM* ol" students had difJirnl[\' wilh flu- 
prohli-nis jn\oI\in[: dc(i?nals. TluMofoic she <hH*idcd (o 
sp(Mu! tnorc (inic wor-kin;; on decimals in Ihc few weeks 
rcriiainin.u in ihc schot)) year. And lie n flua(^ was one stu- 
dcnl; who faiUnl all i\\v (livisicai pinhh rns, alikoii;.^]i lie dirl 
faii-jy well on ihi' r^^sl of the t(^sl. She arraa^^ed h"> ,^iv(^ Has 
stiulfMit special help in divi.sion. 

Most of llu^ sludt'nis hnfl In^lween lU) and 35 ([U(*slions 
riirhl. l-h)W(^vtM\ there wcmc a few who scored idiove. anrl a 
lew who fell Ixdf^w this niirhDe ran^e. Knowinf.^ whicli sfu- 
fhaits were in the midrJlc* anfl which were above or hch^-w 
was useful to NFrs. Jackson in a.ssi.u^nini; rep(»vf-eard j^r;ules. 
or ctjurse slu* als(» took into /tcconnt each pu])irs class 
work arul liis slandin^^ on ofht^r teshs. 

In evaliiatinj4 her test, Mrs. Jacksoa felt if had hoen 
reasonably successful in nieotinK Hu? purposes ft)i- wliich 
she had piaiinod il. I'he (est had ^^iven her ;a ^:ood picture 
o{ over-all class; achievement and it. had pointed up the 
weakri<\ss in decimals. It- liad jiot been plnnned fo bo hiKlily 
diaKiiostic, hut it liad heii)od to irieiitify one jnipil wlio wn.s 
especially weak in division. In arid i I ion. allhouKh the lest, 
(lid not rank all of her students in the exact order of their 
arithmetic abilities, it. had f^^Iven lier iah>rmation that was 
useful f<n- '^radinK purposes. 



,Vii I'^^av 7'('s( to Measure a Special .\l)ih*(\ in 
ljL;fH h-< irinit* A lucj [i an \ I isU)r\ 

Mr, I'rank's eiidii h iirade .Aineric'an }usit»r>- c-Iass liad I)ceri 
sliid\"ink t^''" fi.uhlinL; that took jdacr b(^l\\c-i'n the indinns 
anrl the scl tiers in ihi^ wr'slern stntcs. 'I'he class liad just 
c<\ifa|)|<'ied '-cM'ral discu.-;sions nn the ri,i.dils of <'ach si(!e. 

'I'lie major [jurjjosc of hfuinii jltr-..- discussions was tn 
iiapruNc llie pupils' ability (n find an<l c.xpn^ss ccinviru'jn::l\' 
f.'icts and nrKumeuls in suf)p'ii-l f>r their (»[)iriion7>. 

Ml'. I-'r'anj-: dccid<*d that In* would liki' to ,:;i\"c a lost \u 
measure his class's skill in tl^is ability, At hrst. he <.-oa- 
suiered ,L[i\ inLr an object r\-c tr^st. He tlioufdd \\v mi^'ht lisi 
a munbcr of ar;;ir meats j)j'esent''<i by hnlh (he Indians and 
ilii' seltlei's anfl Iheti ask the <'lass to i<fcritirv lliose whicli 
wj-re hacked u|) by facts. But Mien iKwleeided ai;ainst usin.j; 
this kind of test. An object ive. test would r(»quire the stu- 
dent Irt select sonikI artruuKMds: it would not call upoti him 
i(t (hneloj) and [iresenl them con\"inciniiiy as lie would rio 
in nclaal discussion. .Accoi'-flin.jd.v. Mr. I'^rank decideri that 
essay test \\r)uld satisfy his fair]H>ses best. 

Since I he subject matt(M' of tlie test was limited, il was 
unnecessaiN" for Mr. b^'rank to piepare a written p.' an tor 
ihe test. In a s(mis(\ the test fjuc-sticms lhen>sel\-es consti- 
hued the test plan. Here is tlie test he prepannl. It hacl 
Ibfi'c quesri(ms: 

I.l*relefj(i th;it you art; a settler and L;ive tiireo generai 
reasons wh\' yoo tlliuU your side is ) !)^hf. in the w'iW '.vith 
Ihe IndiEins. f'nr e;ieh of the its'isoas, <lescrihe an acinal 
happeniuK to suppoif yoiij- ar^^umenl.. 

"l. Iheiend that yen aic ari Iii(H;ni an<l ^^ive throe rtiastms why 
you (El ink >'oor si(tr is ri^hl in tht^ \\\\v with the sctlJtirs. 
Vov vacii of (he iciisons, (hisrrihe an ni'Uiiil happc^iiio}; iu 
supp<n'{ y<jm- atjxunient. 

LoiiU at t!U' six reasons Ltivcn l^y ho(h sitles and docide 
whirii (uie woiihl l)e most dan^^(M'OUs if evei yoni' aceepled 
t.his itiiul of I'casoninj^f- (hvc two (ixainples of how peoph^ 
nii^lit do had t hings if (lury aeccptcd t his kUi<l t»C rtui- 
soninj^. 

P»eh)re scor.iny llu' {papers, Mr. Frank analyxcrl (hi» poinis 
which he thouj^lit would appear in nn ideal r(\sponse ancJ 
(K^Mfh'rl how much' he wcnild count for (^ach point. He de- 
cider! not trj !ako otT crtKht for mistakes \n spell ii^.^' and 
I'hi.nhsh usaj;e. But he ()lanncd to show the lui^iisb teacher 
any pa]>er whi<h was especially po(^riy writt(Mi so thai Ihe 
iMiLjlisl! t(\'U'hei' aiif(ht ;:,d\'c^ helj) in conijio.silion writing', to 
those jnipils wlio needed it. 

After ivfr. Frank corrected the iiapers, he found that 
most of the ])upilj; had f)roc(U'flecI well on Questions ] and 
2 rcfpurin*: reasons an(] examplc^s, However, many of them 
had Houndered on Question 3. wliieh required th(Mn to 
point Old tlic danj^eroiis in^plicat ions of one ar/^ument. Be- 
cause of their diflicidty with Question 3. Mr. h'^rank decided 
to o]-«iani/.e a serii's r.l' classroom (Iel)at(\s, ,so that the .stu- 
d(>nts would iXiA practice in extenfiin?(, attacking'', and de- 
fending: an ai*t;unu''nt . 

On an t'ssay t.(*st of this st)rt, scores are not hij^hiy roli- 
aijl". On a second nradinu, after a little time laf)se. Mr. 
f'^ank won hi find it (iitficidl to f.;ive every f.mper the same 
mark as on ihe first r(>a(iin.i.'. Furthermore, sevc^i'a? teachers 
^radinjx tlie same jjajiers would p rob ably not aj^rce very 
closely with one anoflier. Tlic^retore, Mr. Frank avoicJe'd 
^Mvitif^ an exact mimeriual score lV)r (nu:li jm])or but instead 



f (( f .i'r. lu' \\'r<i|(> rnnn\' '.'^'nuni'iils r,\\ iUr \)-\\)('Va Sd {hut 
!lu' pupils v.iiijfri }ta\'c .1 lictjrr idi'ii of llu str»Mi,L;l!is :nu! 
\v''.'ikiirssi > f)l 1 ln'ir ar^iiJi>rnls. 1 Ic iilso ?-r,ul si^^crnl pap('-r:s 
in i\u' r]:i>s \'tn- (Jisrussinn j)nrpi'S(s. jrjajJjii; lulj n!" ilu' 
tc<:i as ail iast rucl i(in:ii ticvicc-. 

A T<.'iHh-(ira(U' lUoI(>,<;v Trsi i'sjxa i allv Disii^ju'd 
t^ aniv SrntU'rHs in Order of .VhilJfv 

Vhr sfiuli^nfs ia Mr. niiarulf^'s (fMi]i;^i ;ul(' hifi!fv::\' flass 
were all in <'nlh\:j:i^-j)rr iviraf <ay c iii i i<'ulma. M(aiM)\-i»r. 
ihfV v.-crc L'ood s('i<'!l(•^' slad'ails v.lifi h.'n] Uvi^d rspcrially 
si'li .'Uwl i"nr af'('{'!rvnl(Ml ^vork. 

AlthtniL'.h il was niiliki^ly thai any (»!' ilur-^c j^Jiid^'iiis 
woiihf f";iil. ("h-'aTulo ^var.^(^(^ (p fmrJ c)hl who wr-rc flu- 

"A" sludriits. wiio writ' (li',' "iV sliaUaiis. aiul who. il any, 
>h«iutfl ))C' !:K'rn "C^." lli^ also ^va^t(■^l tu sclccl Ihrci' shi 
Joif.s for si'l)n]arshij)s l<> ailt-nd a sp(^cMal staiinuT srinicr 
irn^tihit(> a( lln' ^in\c univcrsiiy, 

iX LTct a }ii;:h!y r<-?iahl{' raiikia;^ of fits s'fui:i<'nfs nn i}uvr 
l-:ii(>wl^^;;i' arwl jiiuiorstrinth a^^ of i]u])orja[}l lopics in hioi 
o^y. Mr^ Orlando ;tl(H"iii('(l to ix'wv a s'-ri-'s of irsis on tin- 
various siil>Jorls c'o\raT(l ia coarr^o. Thi- fusf h-st hr 

platuu■c^ was on ;ji ffadiaj^ assiunnuail about antihodit^s. 

lie kiunv -from f)rf\-ious cxfjra-icticc in Icstin.L; (his r^i.ass' 
(liai. if Ills i]uosii(ais ,ii;otlt'r:d!^■ paralli^K-d lli<^ calirc ri-adiiu- 
assi;;nnu'nt. niosi of (h(* I'lass would nnswtM* Ihian coriY-ci !>■. 
Siicli (jiavstioiis Would nol hcl)) him uuicli to j'aiik Ihc sfu- 
(h.aits in pri'ciso order or lo solccf ihf llu't^o scliolarship 
wiimors. Thiavforc. ]jf" <liY*idod lo IVjciis Hiis /rsi on "rri fitvd 
points'" iu thr rfadiiu: ansijznnHait. That is. Uic Irs! cjuos- 
lions would he on (h.u [Jart.s of ihc r(^adin^; assi|;nnu^nt whifli 
wt'i-o hard to ;;rasp and yid wero importanl I'lir rompictr 
undcrstaiulinLC. 'I^hoj^c (jucsiious wouhl have to hu so diF- 
iiculf. (haf av*'ra,!;(^ or I'vcn jrcjod studrnts mi^i7d aicII miss 
thoin, bill tlio \"ory best j^tuflnds wiaild probably many 
oF fboni riiihl- A( 1h<^ same 1iiTu\ Mr. Orlando was vtay 
carornl lo avoid (luostions which mi.L;hi be ditru'ub simpls' 
bt^causi.' tlioy wcru on trivial (Itdails. 

Hv (iivided Hio reading a.ssii^mnoat Into \'<niv imjjorlard 
content ru'cas. Tlien. within oacli r»( lb(^ .onlcnl areas, li<' 
plarmed to b'st for two skills which lu^ considcrtHi crucinf 
for top-ni.^hl science s(u<Ients, Thi^ foui' cotdeal areas arui 
tlu' Iwo skills within Ihest* ar(v\s. as wt^ll as the mmiber of 
((ucslions. aro pr('s<>rif eri in fhe j-cra^ below; 



Ailhouub Mr. (^ria:uin intended lo nsi' ofijecMivf' (jucs- 
(ictn- tnr aicasur'ijc; <k'\\ in (ii-tifda;; icchafc:d Jcrnis. hf ai 
lirs! t[ini3i.;hi iba( be wr)ui(] an-d to use r^s-iy qui-siions for 
nicasui-inu skill in apj"»l\an,Li iafc-rnianon. fa I'act. lie fiad 
;ib-f:idy urdf»'Ci ibc fitllowiiiL: question for tlic tfsl: 

Vo\i ;ii-e Lib/ea two fcst !ubr-. one iubolcd l^vohun K}. Wio 
otbi-r le.b'.'icd Protein X. I buv could y<Mi icll if ■fbrse tulips 
ro.-dl.v CfHiiatned diflVrejii proieijisV Ouiliui' Ibc cNpcri 
ititnda! procedure v'ou woidd follov.'. 

1 lowt'\ er, h > a !isw( 'r 1 1 (is < pics I ion would I :ik*' mruiv" of 
Mie sliidt-nls ai l(\-ist tm nn'miir-s. \i :ui;;h« iid:^- ^"rne of 
llu^ in lti'r ^(udenis i-xcn iotu;iT because Ihcy wculd tend P' 
iies(i-iiic Hu* t*\periinefif in Lircaler <letail thaii ti^e rijlirr-;. 
A! I})is rate, it v.ouid tnke juost f bbe .s(u<len{s \hr Ii.ater 
[)art « >f t he da\- tiiusii (be iC'St . 

'dha'cforf. Mr. nrl;(nd(» beL:;ni (o coiisitfr-r i!ic [)o>.<;tbi ! i I \' 
of u<in^: objec'ti\-e quest ionv' instead, lie rc^^^o^e (he r~say 
cjuesl i<ui. a[)ove. in this w:i\': 

Ynu are ];jven two test (ult(*s, one Iiil)e[c<l f'i(»Ji'in (j. (he 
etiic^r liiheled Piotein V.. Whicli ofn>e I'oHowiiui wonid he 
(he hes( lii^t s| cp to Itnd nnl i C (hi-se I iihcs ri'idl.v conMiir: 
<liiV<*ii'Ul prot I'Mis? 

(.V) Inject a ridibil. wit h riiher I'rot cin i} or rr(>leio '/. 
(U) I'fo/i'ins i) .ind /. m.^elho- lo/u'c wlielher :i pre- 

id[>i{ al l' is formed. 
((■) 'Tala- hietjd fioiTi a cahlji/ ;ind ct'n ! ri fui.:*' nut the rcii 

hinoti ctdls. 

( 0) Add a serum f o eL( Iv, :- ein or l*i'o( ein /.. 

(V,) Inject .1 r;il)1>it a comhinat itiu of l'r(>(<Mn (} ami 

I*rot ein /, 

(.Vtiswer-: A) 



To ansWiU' (his quesfion wttuKJ re(piin^ niost stnderds onl>" 
a numite nv two. Of eourse. tin- ohiecli\'(» qucstiDfi abos-e 
retpiires simpls' selei-jicai i>f the /fc.s'/ sU'j) in e:<p(a'itncnt . 
while the I'ssay (jueslioa wo\dd re<juire a com pich' {hscrip- 
t!i.ii! of it. Yet Mr. Orlar.do fell I hat aio^t (if those wlio 
eould .selcc( (be first sfep eorree/ly woifld als(? be able to 
carry throtii^b the whob^ ex[)erinuMii. Ami by usin;; the 
objei'tive (piestion. Mt\ {^rlatifio was now able (o ask many 
ni{ir(- (p.u^stions than if hi' hati used the essay tyiu\ 

Merc are some other cj nest ions lu^ wrt)if\ The first two 
rcfpiiie an <^vat:^ aaderstandia.i.'' of soaa* of the iecbnteal 
vocabulary in the reading as-si^amieid. 'Hie others refpjire 
applit^dion of iriforination t:iven in the re ad in.- a.ssii;mTHad. 



Questions Requiring Questions Rcmiiring Ap- 
^"^--^ S'/ci7/s: iixaci .Definition of pUcalion of Ii\foiuiaiion 
Coftmu '^---^^ Tcchiikral Terms fromRcailingAssi^nmcnl 



The Antigen - 
Antibody Reaction 

The Rliesus 
Blood latctor 


3 
3 


10 


10 


The A, B, nnd 
O Blood Typos 


3 
! 


10 
10 


The Imporuince 
of Antibodies 
\w Disease 



\ . All nnt ij^en is 

(A) the opposilo an anlil)o(ly 
(U) thi' rosuUuMd' ai\ unli]>ody 
((') st inuilus i'or antibody formation 
(I)) tiie I'i'HiiIl of antihociy format ion 
(K) th(^ same as nn aittibody 
(Answer: (') 

2. 'rji(? antibodies in passivt; inirnnnity are 
(A) ort!atccl by tfio recipient 
(Bl prelbrnuul 

(C) create(t by fresh exposure 

(D) Hclf-reprofiucini^ 

(Kl crcat<*d ])y antitoxins 

(Answer: 15) 'permissiom to reproduce this copy- 
righted MATERIAL HAS BEEN GRANTED BY 

D <e>. Ct*^ 4^*-^ 

„O rWo->i^ 

TO ERIC AND ORGANIZATIONS OPERATING 
UNDER AGREEMENTS WITH THE NATIONAL IN- 
SriTUTE OF EDUCATION. FURTHER REPRO- 
DUCTION OUTSIDE THE ERIC SYSTEM ftE- 
QUIRES PERMISSION OF THE COPYRIGHT 
OWNER" 



In ( lu^ f>))l))\vjnK (ahN* fill in tht' possihlt- iWotxl ^loups (if 
fa I hers. 

tiiiM I 'St' (il t lic A i\ni\ H Proteins Onlw. 



Ktunvii Ukuui (ifoup 
or NKniicr 

J. A 
'1. () 

5. . n 
It 



nio'ki Cnotip I'nssibio H\ok\\ 



A 

Mi 
A 



(Answers; ;{-A. ]?, A 15, (); <\-A, AH: H-A, Ali; r,-A, AB.) 



7. A male ("litlff is born wijji ev^'t lirol>las| osis fetalis vvliieh 
re([itires a hlooil (!A<'hani;e. VVhieli oiM' of tiie folUuvinj^ 

111 list bo ( I IH"? 

(A) The iiiothei' wa.s lUi -f and tiu^ intUcv Uh — . 

(H) '!'he mot her was If h — an(i t iir fa< h(:r \\ as K]i+. 
{<'} Thi'- riiother was H -f- and thc^ father was A — . 

(I) ) The motnei- Iiad U typc^ hlooti and the falJu'}- had 

A t..V| K\ 

(I'",) 'Vho mother lijid O lyp'- hioncl and the fi'Jher Iwid 
AU type. 
(Answer: IV) 

Which of }.Ue followhiK is NOT an irnm nnoloj^ft-al ap- 
pvoaeh to eomhatinj^ disease? 
(A) Salk vaeeine 
(15) (Janinia ^lohtilin 
(C') Penicillin injeetion 
(O) Tetanus toxoid 
(K) Smallpox vaeeinatioi» 
(Answer: C) 

The class fouruf th(^ t(\st cli.'iUonginf^ nnd onJ(i>< fi iioinK 
over the (|iH\sti{>ns with Mr, Orlnnda aftorwards. AltiuiuKh 
Uiert' we IT' n lew questions that most of sliuleiits }:oi 
rijiht niid a few thai ])rvK't legally evt.Myont^ i:<.A, wron/i. most 
ol" iho (jiiosfions wc.to misscerl by ahoiii Jiall' ihn studorits, 
'V\w avin-a^o score in ihc class was 2l] oui of (lio 50 rij^lit:. 
The lowrst si'ore was 9 right and Ihc top sctirc was 18 
ri^dit. The tesl hclpt^d Mr. Orlarulo to ranli tlic^ students 
with same confidence. He fell fliat the iesi. also liclped 
diMnonstrah} to iha clns.s (he kind of reasonini^-f rom-dala 
V('(jujr(Hl lor advancofl work in sci<M^cc, 



A TMclftli-Griulc English Test for Diagnosing 
(lonuHon Ij ioi's in Usage iiihI Spelling 

Ft. wns the he^innin^^ of the school year and Miss Ba^s1f^^\' 
had been assij^ncd n special iwelflh-^racle class in remedial 
l*ini;]tsli. All the f)npils \n her class had fione poorly in 
iiii^h-school l^n^^lisii. TIk^ Eni^lish department had deeicled 
thai thi(*st* pupils shoidd he drilled intensively to h-rii)rove 
llieir basic skills iii composition writin.j; i")cfore firadiiation 
froir/ Iiii^h school. 

Miss Barstow de(nd(nl that slie n(\^{kH{ to use a dla;^- 
■ nostic fcsf to finci out areas of strength tmd weakness for 
eacli jnipil. 



Thi* l\ji.:lish Def)arlmen( had nlready fiesi!inat( li six 
basic (v'pi's <ii ej-ror in ci>rTipo^i t inn 'v ril ini^ tn he corrected 
in This c^lass. These v. ere: 

I .' i ^{in - (<»Lref hc^r senleru'es. or the cornnja-splice: 

"li is snowini: very harrl tr>rlay. the children wdl prol> 
ahiy ^o sleiish riflitii.; l-^morrow/' 
1 n<"Mmpl(4e sentences: 

'"Whi'n the boa! sfriick Du' roi'k and (he v\:iter pnured 
in and the srninrs clinibcfl o]) into the riK-^in;^:." 
S. MisspeHin.i; of conmuin everyday vvortis: 
'■^ 'MJ .should i-('eie\'t' an answi'r lomorrow." 

-1. i )isa;4reeiiK'nt })etweeii snbjecv and \'i^rb: 

"Wlien Ibtw was told what to d<j. lh(\v did il.'" 
f). ( 'onfusion as in Ihr^ ease ol' ])r<)!ioiins: 

"The man V(*fnseii to U^il either Harry or 1 where Ibo 

money \\';is hidden."' 
(i. fi.se oi' unacceplabh^ co|[o(fntal expressions: 

"He coi-dd of won tlie race if be bad tried luirder.*' 

Thf piirfxise of Miss BarsUiw's test was to fuifl out to 
what extent each of ln'r sffidfi^Ls was likely lo make each 
hind of mislnhe listed abr»V(\ 

To «4et an a(-eurat(^ [lieiine for individual diai^nosis. Miss 
Rarslow reali/:(^d that slu' needed a fairly lonj^ lest. Sh(^ 
wrnle 2f) items for ea<'h of (iv;^ G kinds of erroi' — a total of 
120 items. Then slie Nvrofc 30 si'ntenc<*K th.'d. had no errors 
at all. Slie now liacl a f.otal of ImO iteniS in. fbe test. Slie 
)im{ all Uiese iUmtis in random .->rdor anfl icl't (mon}.,di space 
l)(d\s^<HMi tliem for the students to write in the necessary 
corrections. She (old (Ik^ students that, although ^^0 of the 
senfenees were corrf^ct. eacii of \hv others contained a coni- 
i7ion error in (Mther s^)elIin^^ usa^^e, rr j^Manimar. I^fien she 
;il lowed the st lulen ts 2 fifty-minute perif>ds to niai<e what- 
ever clianires they thou^dit necessary to correct the sen- 
ttMices, 

Altei- tlu^ st Ufl(M its had finislied the tost. Miss Barslow 
c]i\ided the sentences into the tyfjes of error Ihoy rep re- 
sent e<l and \]ieu scored each j^^mu]) of '20 sentences r.ojia- 
rately Thus she iiad six scores for es'cry student, one for 
e.'icb of tlu' six Icinds of error, Th(^ 30 corr(H*t seii/eii'^es 
^vere not irt eluded in the sc(u-iti^;. Tfieir furu^tton was lo 
make if a bit more difficiill for the students tf) iflcMitify tho 
eiTors. 

(^sin^ tlio test results. Miss Bars tow was aljle to plan 
remedial ^\'ork for each student's specific weaknesses. 



hask: rules of test-makinc; 
illustrated by the four tests 

You liave now read how ff^nr teachr-rs tackled tlie problem 
of malvint; tests, ^"'rom their experiences ycni can see that, 
there arc basic rules which sbonlfl abriosl al^^•;^ys be fol- 
lowed: 

1, 1 fav(^ the purpose of your test clearly in mind. To what 
extent are you Iryin^^ to measure how well your students 
have learrKvI a i)articu]ar \init of study? To wd"!at. extcMit do 
voii bojjc to rank your slndeiii:' aecuralcly accord inj^ to 
Iheij' alirlilies? How hiKbiy diai,aiosti(* of the strengths and 
weaknesses of individual pu])lls do you want your test 
to ho'! 

"2. Make a careful [)lan for the test questions, Ibiless your 
test oo\-ors a very liniitetJ unit of worlc. th«^ plan should be 



t 



4 



nriUctt. Most plans U>r 1(-sts nrc niA so ^iinplf fh:i1 thi\v 
c:m lie kc'U lirrnlv in miiui. Knrt(u'rin(>n\ v. ncn s^u cv.ir^i- 
iiu" the wriUrn /)l:}n. y<jii Ix'llcr ;jhN- lo rr(oi:ni/c ils 
stnMi.i;ths and \v<sikn('ss(\s. 

If ytnir Icsl is niainl>- diaunostic in a basic skill an^a fas 
v.v.i>' ;\Ii<.-s Jjars(ou'"s I'^ti^^lisli test), yoif shoalrl {)r(/[>ar' af 
It.-ast 10 (incslioiif* — pn'jrra})i\ — Inr ('ach suh-h-sl Ilia? 

y(ni us(\ Tlu'St' suh lrsls should yield separate sroi-i^s on 

\'anniis I'lcriTf-rrs rn'i^dcrl /"cr fuaslcry flir' s;kjll. 
4. H" yful an- Iryin.i: t'> find uxii Itow well y(Hir class has 
n^aslt'Ti'd a jjarlicnlar \Hiil of stufly <as was Mrs, 'lat'l^son 
in Iu>r fif (fi-jrradr arilluiu'fic ((»sl>. you should make a fosf 
whit^j paralh'ls tl^r work ij) riass. (h-nerally spcalrin;:. (his 
test slu)ulfl no! hv too diflif\d( and ctminionfy act'^pted 
ru;uv{* of scvon ty per nad lor a j)assini^ st'<irc is probably 
a})propriaf(' for many rlasscs. 

r>, Wboti (he major purpose ol your test is to rank n 
soh'cled «:roui) of sludcrds in ordf-r of their a(•hi^'^'(MmM■!f 
<as was Hif fnirfjose fif Mr. Orlairdcj's biology lost.). 
(|U('slions sliouhl bt» on "(Maliral" [)(^in1s rif learniru',. TlKvse 
are the pnin<s that lieveiui the superficial an<l obsanus 
''l^hey are "erii ii'al" \u Hie sense lha( if is n('ee.<5sar\' (o 
nndersiand t[i»Mii Inr truly lii^hdest^l achicvonionf. Ques- 
tions "criticar' poinls olten iTCjuire und(ast;»nfliuj: iiu 
p!i(^a^ions. nf)f>lyi uji; inrorma/irui. and reor^rnni/.in^' da/a. 

ViiY ',\ (jnesiiotjs ar«' ask< d only on material \s'hi(di lias 
beiai sfxTifieallv- lan.uld in class and uhich has uicrc^ly 
be rcMui'iiibered. scores are apl to bunrh near the fop of flie 
rariire and will nol lielf^ uiurli in deli^rniijiin;^ an accMiralc 
rank tu'der of achie\'eiii(Mif . I^^or ranlcins; purposes such as 
Ml'. Ork'indoV, <iu<>sfiuns shouhl ;:o bi'vond what has been 
memf)rj/ed and ask j}>e slndenf io use his kno\v]cd,i:(^ in 
ni*\v silualions fnr which il is suifabl(\ rren(a\'dly. the most 
accurafe ra^ikini; will be achievcMl by niakin;^ all tho ciU(\S' 
lions of /ju'flium (T-ffiiadly lor flu* ^^ronp. Ilnl wlion a niaj<ir 
purpO:^e is f<i select a lew of the very l")(vst stucJents» itorns 
slioald be nmr-e rliflii'ult. Mowtn'CT. do not wrifc quc^sficms 
on ifiOM-jsi^cjucnfiaJ drfails ju.st f-afcli sfiideiifs. ,Tijs/f\id, 
focus on impfirfai'il underslandini^s fhaf you think Wm^ 
1)f^fler shidenls slundd ha\'e — Hie kinds of undorstandin.s;s 
y(»u woold not (w^k^-I o\' poorer slafi^'nl.s. Then, even fjje 
hf?st sludcals [\rv Iik'('I>' to miss a few (juesfions. but llieir 
total scores will nivo a f^ood (^slimafe of fludr relative 
.sfandint;s. 



'\'\\r <uiiinuir_s' beii)\^- cf>nipares a ie\^ nf the majnr char- 

Mi'(eri-0 if' (v! I lie I \An f >"P('- 



RSS.AV 



Ahilituvs rsie;isured 



!*e<iuires thi* stiidenl to 
i>N[U'ess himself irs iiis own 
words, usiiiij; inloj-niaiien 
from his own haek^rou lu! 
and knowled}4'r\ 

(\in taj) hij-'Ji h'\-els «tr 
reasoain'j such as re^piired 
in inferenciv orLTani/af ion 
of ideas, comparison and 
contrasl. 

Does not nu*asure jjurel\- 
l'a(dual inforni;di(Mi efii- 
cientl V. 



Ixecpiires th<' stu([ent to 
select cor reef ans\'.'ers t'rom 

en <ipt ioi s. or <(• supply 
miswer limitcMl to erie woi'd 
or phrasi^ 

(^aii iil^a tap hl,i;h le\-C'Is 
of re.'isonini; .such as r(^- 
(juired in inference, or- 
igan :, 'at ion of i<leas. com- 
Ijarisiui and cont rast 

Measures kn( Avied 
facts I fHcitMiffv. 



if 



Se(ip(^ 



C'(u-{»rs (}jdy a limited 
fiehJ iA' knowled^ie in any 
OIK* test . l\ssay cpiesf it)ns 
take SO Ioiil; fo answer that 
relatively few can he an- 
swered in a ^dven peruvl 
of time. .'Mso, the stud<'nt 
wiu) is esptnaally (luent 
call often avoid discnssin^: 
points of whi(di iie is un- 
sure. 



Covers a broad field of 
knowledge in one (est. 
Since oI>iective (piestions 
may be answiM'ed (pdi'kly. 
<Mie tesf may cf^fifain many 
(juesfions. A hi-()ad cover- 
ajve ludps provide reliable^ 
niisisiu'cmenf . 



hu-enfive io Pupils 



fMHvaira^^es impils to 
U^arn how Io ovirani'/.(^ tluar 
(uvn ideas and express 
l.hem effect ivoly. 



I*]n(\)uva^es pupils io 
build up a broad hack- 
;^iounfl of k-nowled^c and 
abilities. 



Ea.se of Preparation 



SPrX:i.\L PROBLEMS IN WRITINC; ANH 
SCORINC; Tl'STS 

After you have de(?i(iod on the ])urposes of the f(^sf and 
have made a WTiftcMi plan to (\i <h(\se piH'pas'es. you wiU 
want to eoMsider th(^ foUowinti: special problmis about uKjk- 
in;; tests and seorii^K them. 



When Slioiilcl l'..s.s;iy Qur.stioits Br Used 
;in<l Wlicn 01)jc( tive? 

There ari' no ratefrorica] rules fo t(dl you winch ty}>e of 
question to us(\ However, it will he helpful to kee]^ (dearly 
in minrl the eliaracteristics of eac() <yi>e. Tfien you will ho 
nb!e to deeid<^ which will be nio.sf suitai)!*' for th(* particular 
purpose and eircumslaiKvs of th(^ test you are making. 



H(^rpu"r(\s writii^^ only a 
f(>sv fjueslions for a test. 
Tasks must be <'h'arly dc- 
■ fin(ul. j^inieral enough t<i 
nfler some ie('SS'ay, si)e( ific 
(MU>u^h to ^oi limits. 



R{'({uires ^vrifin/; ?nany 
(piestiuns for a t(\st. Word- 
hip, must avoid ambiguities 
and ".udve-aw.ays.'' Distrne- 
tors should embody most 
likely niiscrjueept ions. 



Senrini^ 



1 Isually v(^ry t inie-con- 
sunu'ufi fo score. 

P(?rniils feachers fo com- 
ment direetiy on tlie nw- 
soninjj; prcieesses of indi- 
vifUiai pupils. However, nn 
answCM* may ho scored dif- 
ferently l\v flifTerr^nt tea(di- 
iM*s or by the same t(\i(dier 
at di/Verent times. 



('an be scorer] quickly. 

Answ(*r f^eneially score<I 
(july ri;:ht or wron^. but 
scoring is very accuraio 
and consistent. 



ERIC 



How r.;ni Vou [.earn to Wviw BvHcv 
()l);t'ri iw. (>ii('s(ions? 

A ftnnmon probh-nj is how |f> wriir dhjoclivc^ (jui'slinns th:\i 
f.ip t'ornplox nhilitif-s. first, you nr-ed if) <lofinc the k\iu\ oi' 
behavior whirh serms fo ciomonslniic^ [hr nbilify you nro 
tryinj; lo mcasnrr. Thon ask. "How ran f mako up tju^.s- 
fion.^ lli.'ii will olirii this kiiul of ht;h;nior?" 

fn order io }4ol idons f<ir wriffnj^ your own (ost cpic^ifrons. 
you will fiiuf if. usoful io look ovd- flio t|U0K(ions mm\ in 
piiblislicd fosis. You may bo surprised at iho ini^cMinify of 
tlie profes.sionnl tosf-wriler in iN:)nsf ruetin.j^ cpjfstions wbieh 
nieasiiro hij^li-fovcl ahilitios, 

(li)joc'(fvo cjuoslions. /^onondiy sj)eakin<:, ;\ro flnssified into 
lour major (ypos: (\) Multipte-c]ioi<-e, (2) Maiohrn.i:. (3) 
Complelion or Kill-in, (4) Truo-Fiilso. Tbore aro numerous 
vfiriafions nmonfi: /hc^se fvfjes. Tfjoso have hetMi de^rrif)ed 
al, U-nirdi in arlieics on nioasurem^Md and in measurein'Mif 
le\lbo()ks; Mor a bi):»iif)^rraphy .s<'o paj^o K)) , 

foHowinii samp](\s no! only ill iisl rate (he four .uenoral 
types of obje<•li^■o (picstions. IkiI also ofTer furilier evainples 
of bow objeclive (jnestioJts can l)e const rurtod fo recjniro 
not. Jusl nremorizalion of fncfs bui a))})liea(£ons of learn in^zs 
anrl skills \o new si{ nations. 

.Multij)i(t-(hoi(("^ 

1. Tom wan(.e(J tf) Uud whM, efVvd rert.iliy.er bas on ^Mrden 
phinLs.'Ue put tionio j^otxl soil in ^fank'n boxes. To hf)x A 
ho added iVTtili/.er cont iiininj^- a larj^e. amouiit o f n itio^^tui . 
To l>ox H he a<Id<'(f foitih/.or coiUainin^f a kuKfJ iwnonnL 
of phosphorus. In each hor< he planterl Lwclvt; bean seeds. 
Uv watered each box witti tli<; same an-joimt of water. 
One tiling inissini^' fi'oni Toni's expeiimeiU was n box 
of soil wi<;ii 

(A) both fertilizers ad<Ied 

(li) neither iiitro^tjn nor pliosphoi iis juhhMl 
{('} several kinds of seecJs planted 
(D) no seeds pjante<l 
(Answor: \\) 

2. "Many youiij; people of today are taking a jireat interei^t 
in the; ma>|ay,i!ie Suburbia. U is of a fairly ]ar^f<i size and of 
a eonsiderahhi number ofpajii's." In the s<M;<)nd senttiru^e 
above how could the size of the magazine be in{|icate<l 
most <;rreel iveiy? 

(A) By eomparinj^ it with one or two well-loiown maga- 
zines 

(B) Ry ffivin^r len^'tli, width, tliickness, weij^ht, an<l 
number of pa^es 

(C) By drawing a scale model 

(O) By tellinji how many articles iMch issue- contains 
(Answer: A) 



*r(.C'in,'j 1-1 ]jy prnnission of the Cooperntivc *fV^^fM find Scrvlcos. Kflui:n- 
t ion J I Tcaium Savvkv. 
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By permission Army Times PuhUsJiiui^ Company 

The cartoon ilhistiatcs which of tii e following ciiaracteris- 
ti<'s of the party system in the L'nitcMl Stat(;s? 

(A) Stron^r party discipline is often lacking. 

(B) Thi! parti<'s are r(?sponsive to the will of the voters. 

(C) 'Vho patties ar<' oftei^ more concerufwl with politics 
than with tht' nati<)nal welfar(^ 

(D) Bipai tisan.ship often exisis in name only. 
(Answer: A*) 

'1. The situation shown in the cartoon is least likely to occur 
at which of tb<! following times? 
(A) IHiriufi the first s(!Ssion of a new Con^n-ess 

During' a political party convention 
(C) Dnrinji a primary eUM tion cainpai^" 
<0) During a pnisiden tial election campai^ni 
(Answer: O) 

Head tli(^ statt^nenis btilow, carefully i)ayin}; attention to 
theii relation to one another. Then mwX. to ea(;h s( atemcnt 
mark A, 15, or 1) as indicated. 

(A) Jf the statonmnt rontain.s tJiecent/.il idea ai'ound which 
most of the stat.cments can he i^roupcd. 

(U) If the statcnu'-iit contains a niain supporting idea of 
tJie central idea. 

((') If tin', statement c<in tains an illustrative fact (tf de- 
tailed statcjnent rt'Iate<l to a main suppoi tinj4 i<lea. 

(D) If the statement; contains an i<lea or ideas wliich are 
irrelevant. 

1. The Fi<iman roiids conviect<;d all parts of tho Knipirc with 
Home. 

2. Thv Roman roads were so well built tiiut some of tiicm 
remain today. 

One of the j^reatest aciii-evcmen ts of tlie iiomans was 
their extensive and durable, system of roa<ls. 
■I. \yealthy ti avcilcrs hi lioman times used horse-drawn 
coaciics. 

a. Alonjj; Item an rciads caravans won hi hrin^ to Home 

luxuries from Alexandria and the Kast. 
(). In prescnt-day (taly some of the roads used ai c orij^inal 

Ranum roads. 

(Answers: l-B. 2-B, H-A, 1-0, .T-C. (i-C) 
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Complrtion or FiU-hi 

In iho blank of each hcmUimici? write the or nunihor 

wliirh best complt Ics tbo .sfiUiMU'cv 

T. If people's vyvH woro not ^fn.siLivc to bhic lii^lU. objects 

which now appear bliio won hi appear 

(Answer: black) 

2. A ^^{imo was played in which 2S pi?(>i)h^ participjited. The 
avorajio linal score was exactly 78. If 21 people biul scores 
of loss than 7S anil 7 people hud scons of more than 7S 
antl if only whole-n innbor scores were j^iven, then the 

hi)fiiest score ni'ist have beeii at least. 

CAnswi:r; S! ) 

True-False 

In the spacvi at the left, nisnk whether the lU-atenient is true 
or false. Mark phis for Inie and zei'o for false. 

1. If the Casca(ie Mountains wore 5(H1 miles farther 

east, western Oregon would have an increased rainfall. 
(Answer: -f-) 

.2. 'J'hore is no point inside a circle further frinn the 

edj^e of the circle than the Joiij^th of the ra<fius of the circle. 
(Answer: H~} 

How fo avoid fvrfain pitfrdls in wrilinj^ (>l>jo('(i\'L' qiies- 
lioii^j is givon (wf tensive ti'tTifnuMit in iho liferaliiro on tost 
writing. Vitv oxninplo. in midtiple-ehnice or nialcbin^i: itr^ms. 
the liotn wrher is .ndvisod to n^nkc nU Hk* c*boif'o.s f)l.'uiwiblo 
(o one who docs rlol know the rorrcci an.wer. Ho is nlso 
advisod to avoicl fho tiso of so-cidled "sj)oiMfic* deti'rminor.s." 
TCxaniph^s of "spocifir detcnninors" iiro lornis ol" (extremes 
such MS *'nKvnys," "never/* "nil.'* A test-wise student cim 
oftcji ?^iH\ss corrocily thai a statonioiit iisin^ one of tliese 
words is fakt?. On the other liaiid. an extraordiDarily d(- 
tadod or qiialificfl siateTnont — to tnak(^ pxtremo terms hohi 
true — may also lie a "s])e("'ifit: detovniiner." 

1Vo other obvious j^itfalls \'ou iiuod to avoid in writinj;! 
test qiu'siions should idso he mentioned: 



Reading Difficitlty 

Unless you are trying to test readin^^ ability, write your 
questions in language that is easy for your pupils to under- 
stand. 

EXAMPLE 
Poor 

If a man makes a business transaction wherein lie ]>ur- 
cbases a motor vehide for one thousand five hundred and 
twenty-five dollars and at a later date sells said vehicle in 
another l)usiness transaction for one thousand two luuuh'ed 
and sixty dollars, what is his net loss? 

Better 

A man buys a car for $1525 and sells it Inter fur $l'2t)(l 
, What is the difTcrence between the purt^ha.se |)rice and the 

^ selling price? (Answer: $2(i5) 

ERIC 



Always state yrnir fiu(>.sfious so that Wu^vv mn be f)nly one 
into]'pre(at ion, 

EXA]\[PI.ES 
Poor 

The shortosi <]ri.\' of Iho year is in 

(A) Mari'lj (H) Oune iC} September (l.)) December 

T}io shortest day of (he yeiir in (he northern henn'spliere 
is in 

(A) March (B) June (C) September (D) Deeeniber 
(Answer: D) 

Poor 

Wliicfi of llie following books cnu he called humorous? 

(A) A ClirifilJiias Carol 

(B) 7\)m Saw ye?' 

(C) Treasure Is'Jand 

(D) Silas Martjcr 

(The student mi fit Ihinlc he la expected to sehv't more 
tban one of the of)tions becau.se several of the books eon- 
lain lujmorouh incidents.) 

Better 

VVhicli ont? (^f tlie i'ofUfwini; [>ooks is most humorfiusV 
(A) A Chri.^t nuis Carol 
(H) Tom Sati^yer 
(C) Trc<i^nrv Island 
(V)) Silas Marn(^r 
(Answer;' B) 

Some of tli(^ sources cited in the Biblio/^raphy provide 
nunuTous t^xanij^les an<l del ailed <Iiscussioa of def restive 
test ilenis. Many of ihe stock admonitions appear self- 
evident. Yel if t>very il(Mn is not systematically checked, 
defects tiiat hiter sceni obv'ions to yon may siioak by. 
Korfunately. you need nt}t "^o it alone" in trying to pro- 
duce y^ood questions. You will find it very helpful to work 
with another teacher or even a gi'oup of teachers in review- 
ing^ oach other's cpiestions. It is often surprising how easy 
it is to find weaknesses in questions writ.ten by someone 
else, and yet overlook the very same weakne.sses in your 
{)wn questions. 

You will also find your own students are excellent critics. 
If you /;o ov{*r the questions with your students after the 
test, they nie usiially more tlian willinf? to point out a.ii- 
])i^ruities in phrasinj^, falseness in the keyed .an.fwer. or any 
otber flaws. 

How Clan You Improve Reliability in Scoring 
Essay Quest ion.s? 

To be^nn with, you .should state the question in enough 
detail so that your ])upils understand what is expected, 
Ollievvvise many of them will discuss quite ditTerent aspects 
of a question and thcnr answers will vary greatly in length, 
points covered, and general approach. Under these condi- 
tions, you will find it difficult to compare the quality of the 
ditTerent nnswers and assign grades accurat(»ly. 
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r.' ["\". i- ur. i-?::uuii\L- of an fssn>" (|'nsfif»ii ^\■hjcll is ioo 
■•.'■'I'T ;>.!(( .'.v,'<| \)\- r\a!]i|)Ir of nnc v\fn'('fi is staffed in 
iT. ar.-r <it-(aii: 

I■:XA^^^M..^: 

Voor 

^^^j»f.■^ia v.hy mhi (liiuk the railed ,\alion.s Ih.'i'ii ,a . 

-Hi-ri-s or ;i rai)jf;'«'. 

An iin]>urrati1 rin^iiiiui of !hc rniti'd Naliotis i-, to lu'lj) 
sr{ili' fii-piiics l>(>{\\i-fai nahoiis. 1 )rs(a'ihi' how nnf- dispute 
\va>- liaiulii c( Mn'ri'-^shiHw poird Ihl; old !jr>\v tlic si-tfjcnu'id 
illjjsl fafos a ■^('iii'V;\\ s/jciiidh of Ihc T'fdf<'fl Nations. Df- 
srralH- also how oju' dispulc was liaiidU-d iinsiu ctvssriiily. 
[Hiinliim (Mil how Ihis iMnslrah s a maii>ral woaiuK-ss (if the 
t'nih d Naii<.ns. Voiir ('ssa\' shnnhl hi- ahont :U)f) -HM) \vor<ls 
ill lo!).Ldh i'l nr :> paucs in lonidwand). 

\'arif)}!s -> >|, ?iial if proccdiM Ps ha vo Ix'iai sci up ic> j)ia"kr 
llic scoriir.: o( rssay rjih^sMons autre rrliahlcv 'I'hi^si^ pro- 
(•tMhn\^< aj-i' uscl'id hill. nn!Valnaat«'!.\-. 1 iini'-(M)ns;iindai:. Vou 
\v\]\ ha\>> lo dtM'ido hnw cfMiscit'id if»u.siy ycni wish to ^oll(n^' 
th >r pKM-cduiis- — whf'llicr ihi- iiuMM^asc in rciiaiiifil v is 
\\*}r(h I ho arltlj/ ioiud /iiru- ;md cfTorl. 

'J'ho Jo]]()wini. nic'liiod fen* srorin^ <*s.^a>' fjiKstions is 
s( rtl)i'(l h\- (Iridiani. 1( is f](^ar cad and r( lafivrly simjih'. 
Y<jii may find i( nsoful. 

(1) 'I'hr ifSichcT <tnafy:('s Ihi^ ))oinls that lu* third^s should 
h(> made in IIk^ i(i(^al rosponsc (ind a.s.s/i,'/fs a nfititcricaJ 
irci^ltl In fach |>oin(. Some iioinis iiia>- ho of <()-(>ator 
imiinriannc: Imiiro, th(\v wouhl hn wci.udifcfi a])pr(tpr!- 
;d<'ly. The ins(nk'(or iiiny wish (o allou' i'stvit, rrcdil I'tu* 
i-hvir orLi.anizalion of tljjnkiaj^. Sonu'l inifs ]\o jiiay U^c) 
(i\al \u' lannni dnvr-lop a "snorini: lu^y * nnlil h(^ rpads 
a cross-section of shuh-rds' pnf)cr>;. W'licthiM* d<^rivf»<l h\- 
toarl!<'r-analysis. or by analysis o( puj)il rcspojisr^s, (w 
hy a (viniliidrdion of (ho hvn apiiroacfics, ;i syii;(rnia( ic 
nn^lhofl of scoiin?^ usin^'- ninncrical vnltios or jxTrcidaf^cs 
increases r»})jcclivil \-. 

(2) Tile Icsl r('ad<^r cralnrih'.^ all Ihc rc.v/)o/?.^v'.y ta one 
(lUf'sfio}} Ijcforc^ piin^r on fo scort* the .lesd, question. 

('U As the teacher reads, he /n.sse.s* Ihc papers into firr 
pifcs (iiijrli fo low in qualily). This; prru'c^hire 'may he 
unne(-e.ssarv W Ihe inslrn(^tor is sa/i.\*f)ef) \\-]ih the (jiiiin- 
titalive a])prrdsal des-(rih(fl in I"! ) nliove: hnf if he als(» 
wnnfs a (jiial itat i ve fvstiniale. h(^ ma\- incd to la^-check 
his classific^at ions to (U'lerndru^ if (h(^ ])apers in each ])i1e 
are ind(»ed i^f similar (piahfy. 

(di Anf.>ny/i}i'(y /.s- /ircrssary lor I fie acct aa^f* sr'orfn}:^ 
essay lesis he(v:)use of the id)ifpiilous "hmO f^ifiMd." 1'he 
easii\sl way h) pre\-erd lids kind of suhjecjjs-ity is lo ask 
pupils {(I urile I heir r. iini\s o;/h- on the hnck f>f (ludr 
fesi papei's. 

Since il is fliffifull lo ;.;rade es>a>'s reliably. yo\\ wIM 
usually he more ctnici riied v\it]j wrilin*:; comnieiits than 
awarding; i;radi's. Y(nrr writ (en coimneid on a paper will 
h(dp iho shulent mon.' ihim a ^rado in undcrsfandin;^ his 



strrnuUi-. and \v (\akni'sses. 1 Iowe\-er, if (\ssa\' tests nuisl be 
nsi'd (or L^radfs n-liahi(jj>- can hr inrrc^tsed hy hasiii/;: th<^ 
linal y}\u](^ on se\-eral essax' icMs ratlier Hum r)no. 

W'hiw Kind ol .Si;dis(i(al .Ajialy.si.s of Test 
(hirst inns SliDuld 1 iuTciiciit r M;ikr? 

"i he \ ery wor-ds '^stal isi ics" causes s<uni' (eacln-rs to shuddiT 
atid feel i«)sl. d'his neinl not be. Practical slalislics can W 
qnile :siniph\ Dl conrse few tca'cluM's are willing lo spend 
lime (U( statistical analysis of a (iiiestion that is not to be 
Usr'd a.Liain. lfo\\f\er. many (eacluM's ari* well aware of Ihe 
.ad\anlaL;es of ;i ((jpions sloekpiie it\' ^jueslions. Tf cerfain 
charaetrrislies «>f these (piestions are knowai. it is pcfssibb^ 
lo df^ii;n a lest more e{lVcli\r-ly lor a sp(*c-ific purpose anrl 
,ur{uip. 

Two simplified procedures hy which lea< h(a-s can obtain 
su( li iidbianat ion about Mieir ii^^t items fjave been des(a ihed 
in fietaj) in two pid>b(\'d ions iislerl in ibe j^iblio^^ra j)l)y. 
ni<Ml(>ricli ( j) urines p\i])il participation in (lie analx'sis oC 
lest items, ( ■nii)hasi/in.u i nsl ruet ional \ahi(^s. Kal/. il) 
shosvs how fhe (^la.ss loon^ ((Richer can com|)hde an item 
analysis in nwiiarkablN" !i((h- time. In ^enerah item analysis 
tt lls yi>\t \\\(f i\i'n]'j,s ih:\t you will want U} kn<nv abotil Ihe 
f/uesliojis yfjii are kei^pjn.i; in \(Hjr stockpile: (!) how dif- 
fiiiilt each ([liestion is: (2) how well each question dis- 
criridnates between ht:4li- and low-ranking^ students on Uie 
test as a whole, 

A siirii>le m(\isur(^ of flifHtadly is fho per cenl of students 
who liot the tjO(\s(ion ri^ld on any one test. For cxamrde. 
the first lime yon usr- a particular question. To per crad 
of lire sludeids may fH't it riiihl. If yoci keef) a card file ol 
\our {jueslions. I ben on Ihe back of th(^ card for I las ques- 
tion you wrib^ {he datV and "7~y% rij^bt.'' You mnke a 
sindlar entry rvery liiiu^ y(ui use Ihe question. Then, know- 
ini^ in ad^'ance ihi* probable dinicidly of (lu^ qu(\stions. yon 
Nviii he ahte (o *'(ailor'* your t(\s( (in a style fietermine<l hy 
\'oiii' [){jrp(»s(0 lo fit. ihi' ability {(n^el of your cl.iss. 

As tlie basic rules { {la^es d-o) point (»d out, when you 
want to see \\liether your <4.ass has mast en 'd a fundamental 
unit (^^ study. (pir'sli(Mis will tend to be easy. But wIkmi the 
I>rincipal i)ur|)ose iA Ihc t(>st is lo raidc all the stiulenis in 
the !4i't»up in orfler of ability — for example, in <rlv(^ thoin 
i:r/jdes wide]) n'{]cc\ siaiuiin/i in r-la.ss — try to use qnp.^tions 
whi(^h are oi ndddle difriculty. '^ Tf you want to discriminafe 
more precisely amonj^ the b(dter students (as Mr. Orlando 
<Vn\). all of llu* (juestions shonhl bc^ of j^reater ftiffieuHy. In 
fail. t(^st -makers sp(^dv of "jicakinr: a tesf at Hie cut -ofV 
[)oifd" — that is. /ryin;^ lo make eacJ] tost item so (YifTicult 
thai (on a free resjj<ins(^ test) <jiily about r>0",; o\' fhe l()\vest 
pupils seK'Cted or hiL;hesl pupils reject<'fl will answer it 
correctly. 

or course, in wrilin<^ difTundt, questions, you will take care 
lhaf (he difticadfy is basefl on sij;n]ficnnt parts of IJk^ class- 



*l(iiNilly. Tor ihi.'V iHirpdsc. i-mcIi i| ik-.sI ion i>n w rroc-rcsiJfiri.'^c l<'t,| slioulcl Ik' 
sc. tiifticuK I hut oJtly ■'".(C . ui' l lio j^rnjip ^.rl il l itiiil : <(M a n-npt iViji mull iplc- 

Hilso, - ;(ss,ii)niijii th;il j tu- scort- is tliL- miiMlioi- ni' ilfnvs ans\vc-n'<l 
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wr»rl;. whirh yt>\)i In'ltf-r :-;fiulrr)fs sfionifi he ablr in uruior 
s(;iri(]. As hus aii'pjirly Ix'on cifipliasi/.H], Hk^ diffifirHy 
s?-.ouI(| jiol ho h.'isffl on ni(>niori/atir;ii of (ri\-i:i] fN'tjiiI>; or 
result fmvn irirky or rn7il)i;^iious \\'f)r(liiij4. In oflv-r worrls. 
your ({ncslioiis sh(nil(! }k« iVtir and [riil>- r^'pi'tv-n-atalivt' of 
iin()(»rl;inf trarliin;: ohjcflivi'S. \'(»ry <iflcn (iiu-slion« that 
rccjuin- [>w]'ils - tf> :«ppJy inA'rjnalion Icamrvj in t]\o r-lasj^- 
room to new sihiafioas arc f^nfwf for tliis purpose. Thf 
sci{«ncM 1(\st lliat Mr. Orlando mado Cor his iiiolr,;^y class 
included many cjiff'stions f>l" Hii> typo. 

Tji c-ounrclioM with difHeulty. rnosi lesis slionid <:ivc' your 
stuficnfs siiflicionv (iruc to consider i^a<'h titiesHon and 
answer it (o (Ik- hest of their ahililies. Prol)ahIy ahouf 90 
f)er cetd f»f Ihc slufienls should compUMe all the cjuestions 
(Ml a Of roursi'. if your purpose is U> fesf spiM'fi itself, 

then you will expee! tewr^r stuflenls to Huisli the lest. For 
example, if you were testing; .spp^erl of r 'adaitj. you mi.uhl 
(^xpect only It) Id la p(»r c(*nl io answer all tJu* (luestions. 

I)i.s( » iniitiiif ion 

You will waid to kno\\' li<f\v efVeel ivr'l\' i-aeh rjueslion eon- 
frihnle-s {i\ the fliscriminatiou ]>e(vvcen the hii,di-sc(5nn.ii and 
low-sc^oi'in}.!: pupils on the lest as a whole. Tf an iniporfanf 
purpose of your lest is in rank studeats aceorch'nt; to aliilify. 
sraTio fpiestions will !udf) Uiore (liau (jtliers. 'fdie diseriniiiiat- 
inK p<n\'er of each (jUf^sficin <'an he estimated hy these .steps; 

1. Arranf4<' (he test papers in onlta' of scores, \vith flie 
hi;4host. .scorr- on top. 

2. Take a specified quantity (trai are easy to hanrlh^) of Iho 
papers from ihc t(»f) anrl the sanu* tiuantiiy froiti ti:" hot,- 
toni. IMace Iheni in si'p.'U'afe piles caller! Hi^h nnrl T.o\v, 
resjiectively. 

^^. Now yon are r{^afly to analy/e llie inrfividi.ial q^i^'-'^tions. 
For ea<*h question count the number of Mighs who p:ot. it 
ri^dil and the numh(M' of Lows who f^oi it. ri^ht. 
^1. Cojn'orl .t h(\se numhers to per cents. Tf lh(^ (juc^tion is a 
jxood one lor ranking' ^lurlents, thf*n suhstantially more of 
the Hii^hs than Lt>\vs will have answered ii corveeily. 

I'\)r example, assume tliere are 10 s(ud(M"its in the tn]i 
f^roup and 10 in (he hotfom /^'roup. On the Hrsf question. 
8 of the Hi-hs (80%) hut only :\ of the T.f>ws (^0'';,) ^ot th(> 
rijrht answer, Tliis is a ;^ood quest [f>n for ranking slurlents 
l)e(\nuse if. i.s dear thai the students who {:;enerany did well 
on the test wer(* ahle t.o jL^et \ho rpiestion ri^ilit, while tliose 
who did ])norly on the tost as a whole tenrled fo it 
wron.i;. The per cent of th(^ top f^^roufi anrf tlio per ccait, of 
the bottom ^•,roup gc^tt inj^ th(» item rit^ht uTay he written on 
tJi(* hack of the question card in your slnrkpih^ of items. 
In the exaniph' ^;iven a])ovi» you won If I lu^te ]i=80*'^',, 
\j = ^{)%. T.aler you may reft^r to this information in as- 
seml)linj;" a test which will he especially cfTcctive in fli.s- 
criminat.ion. 

You wil? want If) take a olo^e and sns])icic)u.s "seconrl 
\i>ok" at any question where the to]:) students liad as much 
difluMtlty as the })oorer students — or more. Possibly tlio 
(|iies(ion Is not .so clearly stalofi as it shouhl l>e. If it, is a 
multi])le-f:hoice item. i)erha])S one of the "wronj,'"' c)plion« 
is too close to i)cin}^ correct . Look over each finest ion whe.ro 
the results of the analysis intlieato the jjossihility of a flaNv 



in tlie fjuestit^n and dt^ci/ie \\h< Iher \-f>t: can impr<n-e the 
qiiestinrt hy j-ewritiuii. 

^Vh('n Sliould ^'ou Use ;i Puhlishrd Tcsi and 
\Mu'n .Should \ou ^lukv Your Own? 

If a pnlilishc'd a(^hie\-emi-nt test rficc/r fhr poifits^ yon wisli 
to measure. \'on may use it inst(s'ul of niakin.!; your own 
. test. Sometimes. li(twe\'er. it is irnpos.sib)f^ to find a pub- 
lished test that matches what \'ou want io measun^ — |)ar- 
ticu!afl\' if you w.mt a lest cctverini": a single unit of study. 
Thus, when you i]ovd a !esl covert n.i; ejuiy a few weeks of 
class work, you will orflinarily make your own. One im- 
portant henetjl frotn |)r<'[)apini; your own test is that llie 
vi'ry pi'ocess <ir wri I in?: f|neslions forces you Io detin<' y(uir 
^ ou-n teacln'n,': ohje<'tivos in liTms of spt^ific skills anf? 
uuflerstandinf^s. 

However, there are niany limes wh(Mi y<ai may fleririe 
to use a published test. And. of rourS(\ yf)ur school ])rob- 
al)ly L;ivi\s stanflardi/e'fl tests as j)arl of its I est in?,' prtii^ram. 
Thi'se tests ofr(^r sevr^'af advantages. They have been 
writl(Mi by specialists so thai the i^eneraf quality of ques- 
tions is hiuh. They ha\i^ been subject ed to <'an'ful statistical 
analysis so that the t]ui\sti(»ns fire (controlled for flifhculty 
ruifl tliscrim J nation. ']'liey are accomfianied by norms so 
that you ar<' abh^ to I'omparc* the ])<'rformane(^ of ytnir 
pupils with the jierfortnanee of a re]>resentai.ive .sample 
with known charafilfTistics. 

.'\nfl finaUy, thi.^ fad that well -constructed achieN'oment 
tests liav(^ l)een prejjarerf by »;i'oups of e>.i)eri(Micf^d teacliors. 
wliose eumpetence is j^euerailv recoiiniy.iul . ^i'i\'es you a 
check on y<iur jufl.i;menr of what shouM hi' measured. Their 
consensus on skills and undei'slandini^s to he C(n-erefi is not 
nec(»ssarily Iietter Ifian yours. Rut if i( is suhstatd iall>' flif- 
f{'!-enl from yoip'.'^, it providf\s a N-ahialile suiJ|)lemenl to 
your est i ma tf\s of stutlent aciu'''N<M^ient in any area. Ft ftives 
some ntitiijfi of liow w(dl your ])upi}s o»an do on a test of 
Irp.rnin^^s lluU t;\'ichers in f^enorai m:\y ef>asid(M' important. 



A. AV()i*'d m Closing- 

The mf\sl scrnpuliais heed fo]- all the cautions, a(!mf>nit ions, 
priucipl(»s. and |)roc(Hlcres discusscfl in this pamphlid will 
not ^juarantee that you will make {^ood t<'si.s — allho\i|L(h it 
may do imudi io pr(^vent had ones. Good te.st.s camiot he 
written iiierfdy b.\' t\)llowin?^ any s(d of "rules.'' There i.s an 
art to good test -writing which invoK'cs element.s of orig- 
inality and ('ri nativity as w(dl as knowledge of tlieory. This 
pnmpiihd. does ]ioi preteufl tn provide compel enc(^ in ali 
elements of the art. Such (Competence s(U>ms to thri\'e on 
|jra("tif'e. criticism, tryoid, analysis, atitl more practice. 

llowe\'(a\ Das pamjihlet floes at.lemi>t tf) [osier an atti- 
tufle and ajiproacn V'b?ch have helped many teachers to 
impros'e their tests. It has |)resented some ess(Milial prin- 
('i|)le.s and some realistic ilhistratif)n.s fo serve as guifle.s 
and touchslon(\s in your cfTnris to make better classroom 
tests. 
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